Systematic Perturbations of Discrete-Time Stochastic Dynamical Systems
نویسندگان
چکیده
The discrete-time stochastic optimal control problem is approximated by a variation of differential dynamic programming with systematic calculations of the perturbations due to small stochastic noise. This problem is related to the dual control aspects of stochastic optimal control problems. The motivation is to correct prior calculations for missing terms and to examine the foundations of the method. The state vector is properly expanded asymptotically, in addition to the control vector, in contrast to previous solutions. Corrections are given for the small noise expansions of the solution.
منابع مشابه
Filtering Approximation Using Systematic Perturbations of a Discrete-Time Stochastic Dynamical System
The standard problem of groundwater pollutant remediation by well pumping is modeled as a discrete-time LQG stochastic optimal control problem. The control is approximated by using a variation of differential dynamic programming (DDP) that includes systematic perturbations. Kalman filtering is used to estimate the partially observed state variables in a tractable format. This is a filtering app...
متن کاملMultidimensional characterization of stochastic dynamical systems based on multiple perturbations and measurements.
Generalized nonlinear response theory is presented for stochastic dynamical systems. Experiments in which multiple measurements of dynamical quantities are used along with multiple perturbations of parameters of dynamical systems are described by generalized response functions (GRFs). These constitute a new type of multidimensional measures of stochastic dynamics either in the time or the frequ...
متن کاملEigenvalue Assignment Of Discrete-Time Linear Systems With State And Input Time-Delays
Time-delays are important components of many dynamical systems that describe coupling or interconnection between dynamics, propagation or transport phenomena, and heredity and competition in population dynamics. The stabilization with time delay in observation or control represents difficult mathematical challenges in the control of distributed parameter systems. It is well-known that the stabi...
متن کاملT-S FUZZY MODEL-BASED MEMORY CONTROL FOR DISCRETE-TIME SYSTEM WITH RANDOM INPUT DELAY
A memory control for T-S fuzzy discrete-time systems with sto- chastic input delay is proposed in this paper. Dierent from the common assumptions on the time delay in the existing literatures, it is assumed in this paper that the delays vary randomly and satisfy some probabilistic dis- tribution. A new state space model of the discrete-time T-S fuzzy system is derived by introducing some stocha...
متن کامل